Papers with Machine reading comprehension
CALOR-QUEST : generating a training corpus for Machine Reading Comprehension models from shallow semantic annotations (D19-58)
Copied to clipboard
Frederic Bechet, Cindy Aloui, Delphine Charlet, Geraldine Damnati, Johannes Heinecke, Alexis Nasr, Frederic Herledan
| Challenge: | Recent large corpora of triplets have opened the door to supervised machine learning approaches for Question-Answering. |
| Approach: | They propose to generate questions from the semantic Frame analysis of large corpora using a CALOR-QUEST resource in French and use it to improve machine reading comprehension. |
| Outcome: | The proposed method generates questions from the semantic Frame analysis of large corpora and then tests them on the CALOR-QUEST resource in French. |
On Making Reading Comprehension More Comprehensive (D19-58)
Copied to clipboard
| Challenge: | Getting machines to "understand" text is a vast and long-standing problem, made more challenging by the fact that it is not even clear what it means to understand text. |
| Approach: | They propose a question-based approach to machine reading comprehension that uses a natural language question to test a system's comprehension of a passage of text. |
| Outcome: | The proposed questions have surface cues or other biases that allow a model to shortcut the intended reasoning process. |
Answer Uncertainty and Unanswerability in Multiple-Choice Machine Reading Comprehension (2022.findings-acl)
Copied to clipboard
| Challenge: | Machine reading comprehension (MRC) systems focus on selecting the correct answer to a question given a context paragraph. |
| Approach: | They propose to use machine reading comprehension (MRC) to assess the ability of systems to understand natural language. |
| Outcome: | The proposed system outperforms a system built with an NOA option . the results show that the system is not confident about the NOA choice . |
Tracing Origins: Coreference-aware Machine Reading Comprehension (2022.acl-long)
Copied to clipboard
| Challenge: | a recent study has enriched pre-trained language models with syntactic, semantic and other linguistic information to improve their performance. |
| Approach: | They use a pre-trained language model to leverage coreference information to enhance word embeddings . they use additional encoder layers to focus on coreference mentions or a relational graph convolutional network to model the coreference relations. |
| Outcome: | The proposed model imitates the human reading process and leverages coreference information to enhance word embeddings. |
Towards Medical Machine Reading Comprehension with Structural Knowledge and Plain Text (2020.emnlp-main)
Copied to clipboard
| Challenge: | MRC has achieved significant progress on the open domain in recent years due to large-scale pre-trained language models. |
| Approach: | They propose a machine reading comprehension model which exploits structural medical knowledge and reference medical plain text to improve the exam's accuracy. |
| Outcome: | The proposed model outperforms existing models with a large margin and passes the exam with 61.8% accuracy rate on the test set. |
OPERA: Operation-Pivoted Discrete Reasoning over Text (2022.naacl-main)
Copied to clipboard
Yongwei Zhou, Junwei Bao, Chaoqun Duan, Haipeng Sun, Jiahui Liang, Yifan Wang, Jing Zhao, Youzheng Wu, Xiaodong He, Tiejun Zhao
| Challenge: | Existing methods to predict logical forms ignore the utilization of symbolic operations and lack reasoning ability and interpretability. |
| Approach: | They propose an operation-pivoted discrete reasoning framework that uses symbolic operations as neural modules to facilitate reasoning ability and interpretability. |
| Outcome: | Extensive experiments on DROP and RACENum datasets show the reasoning ability of OPERA. |
DuReader_robust: A Chinese Dataset Towards Evaluating Robustness and Generalization of Machine Reading Comprehension in Real-World Applications (2021.acl-short)
Copied to clipboard
| Challenge: | In order to comprehensively verify the robustness and generalization of MRC models, we construct a real-world Chinese dataset - DuReader_robust . |
| Approach: | They introduce a real-world Chinese dataset to evaluate the robustness and generalization of MRC models from three aspects: over-sensitivity, over-stability and generalisation. |
| Outcome: | The proposed model fails to perform well on the challenge test set and may provide suggestions for future model development. |
Modeling Hierarchical Reasoning Chains by Linking Discourse Units and Key Phrases for Reading Comprehension (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods of logical reasoning focus on entity-aware information but ignore hierarchical relations that may even have mutual effects. |
| Approach: | They propose a holistic graph network that deals with context at both discourse-level and word-level as the basis for logical reasoning. |
| Outcome: | The proposed method improves on logical reasoning QA datasets and natural language inference datasets. |
Benchmarking Machine Reading Comprehension: A Psychological Perspective (2021.eacl-main)
Copied to clipboard
| Challenge: | MRC is a task that tests the ability of a machine to read and understand unstructured text. |
| Approach: | They propose a theoretical basis for the design of MRC datasets based on psychology and psychometrics and propose shortcut-proof questions and explanations as a part of the task design. |
| Outcome: | The proposed datasets should evaluate the model's ability to understand context-dependent situations and ensure substantive validity by shortcut-proof questions and explanation as a part of the task design. |
Multi-Passage Machine Reading Comprehension with Cross-Passage Answer Verification (P18-1)
Copied to clipboard
| Challenge: | Recent years have seen rapid growth in the MRC community . MRC is believed to be a crucial step in building a general intelligent agent . |
| Approach: | They propose an end-to-end neural model that enables multiple passages to verify each other based on their content representations. |
| Outcome: | The proposed model outperforms the baseline on the English MS-MARCO dataset and the Chinese DuReader dataset, and achieves state-of-the-art performance on both datasets. |
What If Sentence-hood is Hard to Define: A Case Study in Chinese Reading Comprehension (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Explicit Span-Sentence Predication solves location unit ambiguity problem in many languages, allowing model to determine which sentence contains the answer span when sentence itself has not been clearly defined at all. |
| Approach: | They propose a machine-learning reader with Explicit Span-Sentence Predication to solve this problem by analyzing Chinese sentences. |
| Outcome: | The proposed reader achieves state-of-the-art on Chinese MRC benchmark and shows great potential in dealing with other languages. |
Enhancing Pre-Trained Language Representations with Rich Knowledge for Machine Reading Comprehension (P19-1)
Copied to clipboard
| Challenge: | Recent results show pre-trained language models (LMs) can improve machine reading comprehension (MRC) Experimental results indicate that KT-NET offers significant and consistent improvements over BERT . |
| Approach: | They propose a method that leverages external knowledge bases to improve machine reading comprehension (MRC) KT-NET employs an attention mechanism to select desired knowledge from KBs and fuses selected knowledge with BERT to enable context- and knowledge-aware predictions. |
| Outcome: | The proposed model outperforms baseline models on ReCoRD and SQuAD1.1 benchmarks and ranks 1st on the ReCoDR and SQUAD1.1 leaderboards. |
Incorporating Syntax and Frame Semantics in Neural Network for Machine Reading Comprehension (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for machine reading comprehension rely on manually defined features and are difficult to generalize to other tasks. |
| Approach: | They propose a Syntax and Frame Semantics model for Machine Reading Comprehension which takes full advantage of syntax and frame semantics to get richer text representation. |
| Outcome: | The proposed model outperforms ten state-of-the-art models on machine reading comprehension tasks. |
MemoReader: Large-Scale Reading Comprehension through Neural Memory Controller (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to machine reading comprehension are limited in understanding, up to a few paragraphs, failing to comprehend lengthy documents. |
| Approach: | They propose a deep neural network architecture to handle a long-range dependency in RC tasks. |
| Outcome: | The proposed method outperforms existing methods especially for lengthy documents. |
Synonym Knowledge Enhanced Reader for Chinese Idiom Reading Comprehension (2020.coling-main)
Copied to clipboard
| Challenge: | Experimental results show that our model achieves state-of-the-art performance for Chinese idiom comprehension. |
| Approach: | They propose a model that can mitigate the inconsistency between literal and literal meanings by incorporating the synonym knowledge enhanced reader into the model. |
| Outcome: | The proposed model achieves state-of-the-art on a Chinese idiom reading comprehension dataset. |
Does Structure Matter? Encoding Documents for Machine Reading Comprehension (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing Transformer-based models for machine reading comprehension treat documents as flat sequences. |
| Approach: | They propose a Transformer-based method that reads a document as tree slices and jointly trains and consults the modules at inference time. |
| Outcome: | The proposed method outperforms several baseline approaches on two datasets from varied domains. |
Clinical Reading Comprehension: A Thorough Analysis of the emrQA Dataset (2020.acl-main)
Copied to clipboard
| Challenge: | Medical professionals often query over clinical notes to find information that can support their decision making. |
| Approach: | They propose to use expert-annotated question templates and existing i2b2 annotations to create emrQA, the first large-scale dataset for question answering based on clinical notes. |
| Outcome: | The proposed system can answer clinical questions without using domain knowledge. |
Learning to Ask Unanswerable Questions for Machine Reading Comprehension (P19-1)
Copied to clipboard
| Challenge: | Existing models for extractive reading comprehension are not good at deciding whether no answer is presented in the context. |
| Approach: | They propose a data augmentation technique by automatically generating relevant unanswerable questions according to an answerable question paired with its corresponding paragraph that contains the answer. |
| Outcome: | The proposed model performs better on the SQuAD 2.0 dataset than the baseline model and the BERT-large model. |
Natural Response Generation for Chinese Reading Comprehension (2023.findings-emnlp)
Copied to clipboard
| Challenge: | MRC models trained on labeled answers are limited in generating human-like responses in real QA scenarios. |
| Approach: | They construct a dataset called Penguin to promote machine reading comprehension . they use 200k training data with fluent, well-informed responses to train models . |
| Outcome: | The proposed dataset is the first benchmark towards natural response generation in Chinese MRC on a relatively large scale. |